IN THE CLAIMS 



1 . (Previously Presented) User interaction system, comprising: 

an electrical apparatus; 

a portable pointing device operable by a user for pointing to a region in space; 
a camera taking a picture; and 

a digital signal processor, capable of receiving and processing the picture, and capable 
of transmitting user interface information derived from the picture to the electrical apparatus, 
wherein the camera is connected to the pointing device so that in operation it images the region 
pointed to. 

2. (Previously Presented) User interaction system as claimed in claim 1, wherein the user 
interface information includes apparatus control data for controlling operation of the electrical 
apparatus. 

3. (Previously Presented) User interaction system as claimed in claim 1, wherein the digital 
signal processor has an object characterizing means for characterizing an object or part of the object 
present in the picture of the region imaged by the camera, by providing first object characterizing 
features to object identification means for identifying the object, and which object identification 
means is capable of outputting object identification data from which the user interface information is 
constructed. 

4. (Previously Presented) User interaction system as claimed in claim 1, wherein the digital 
signal processor comprises: 

motion trajectory estimation means for estimating a motion trajectory of the pointing 
device and outputting a first motion characterizing signature, a signature being a mathematical 
abstraction of the motion trajectory; and 

signature identification means for identifying the first motion characterizing signature 
and outputting contmiand identification data, which represents a user interaction command. 
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corresponding with the first motion characterizing signature, from which command identification 
data the user interface information is constructed. 

5. (Previously Presented) User interaction system as claimed in claim 3, wherein the digital 
signal processor includes identification improvement means, which are capable of further improving 
a probability that the object represented as object identification data, and user interaction command 
represented as command identification data, are more reliably identified based on predetermined 
rules, yielding more reliable user interface information. 

6. (Original) User interaction system as claimed in claim 5, wherein the predetermined rules 
comprise probabilistic calculation of the likelihood of an {object identification data, command 
identification data} - pair, taking into account at least one of the following a priori known 
information units {room in which the pointing device resides, previous command issued by user, 
statistical frequency that a user issues a particular command and time of the day} . 

7. (Previously Presented) User interaction system as claimed in claim 3, wherein the digital 
signal processor includes object association means for providing to the object identification means 
object association data - comprising at least one of the data entities being: associated object 
characterizing features and object related data - , 

the object association data being derivable from object template data in object 
memory originating from at least one of the methods: 

the object template data is obtained from object training means performing a 
predetermined calculation on second object characterizing features outputted by object 
characterizing means; and 

the object template data is derived from inputted object data. 

8. (Previously Presented) User interaction system as claimed in claim 4, wherein the digital 
signal processor includes signature association means for providing to the signature identification 
means signature association data - comprising at least one of the data entities being: associated 
signature features and command related data-. 
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the signature association data being derivable from signature template data in 
signature memory originating from at least one of the methods: 

the signature template data is obtained from signature training means perft)rming a 
predetermined calculation on a second motion characterizing signature outputted by the motion 
frajectory estimating means ; and 

the command template data is derived from inputted command data . 

9. (Original) User interaction system as claimed in claim 4, wherein the first motion characterizing 
signature is derived on the basis of successive pictures imaged by the camera at respective 
instances of time. 

10. (Previously Presented) Pointing device for use in a user interaction system as claimed in 
claim 1 , comprising a camera and being capable of sending a picture to 

a digital signal processor. 

1 1 . (Original) Pointing device as claimed in claim 10, wherein the pointing device is capable of 
sending a picture to the digital signal processor, which is capable of sending user interface 
information to an electrical apparatus based on the picture. 

12. (Original) Pointing device as claimed in claim 10 wherein the digital signal processor (120) is 
comprised in the pointing device. 

13. (Original) Pointing device as claimed in claim 10, comprising motion sensing means for sensing 
a motion trajectory of the pointing device. 

14. Original) Pointing device as claimed in claim 10, comprising a characteristic projector for 
optically projecting a characteristic pattern towards a region pointed to. 

15. Original) Pointing device as claimed in claim 10, comprising a programmable user interface 
code generator and a wireless fransmitter for fransmitting the code to the electrical apparatus . 
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16. Original) Pointing device as claimed in claim 10 comprising feedback means for feedback of 
user interface information. 

17. (Previously Presented) Electrical apparatus for use in a user interaction system as claimed 
in claim 1 , comprising means which allow the electrical apparatus to send information about 
supported commands to a pointing device , based on an a call of the pointing device to the electrical 
apparatus. 

18. (Previously Presented) User interaction system, comprising: 

an electrical apparatus; 

a portable pointing device operable by a user for pointing to a region in space; 

a camera ) connected to the pointing device so that in operation it images the region pointed 
to for taking a picture; 

motion sensing means for estimating the motion of the pointing device; and 

a digital signal processor, capable of receiving and processing data of said picture, and 
capable of transmitting user interface information derived on the basis of said picture data to the 
electrical apparatus. 

19. (Previously Presented)User interaction system as claimed in claim 18, comprising means for 
estimating the motion trajectory on the basis of the output of said motion-sensing means. 

20. ((Previously Presented))User interaction system as claimed in claim 18, wherein the motion of 
the pointing device is estimated on basis of successive pictures imaged by the camera at respective 
instances of time. 



N:\UserPublic\PWWL021130\NL021130US_PrelirmniuyAmendment 2009Jaji09.DOC 



5 



21 . (Previously Presented)User interaction system as claimed in claim 18, wherein the motion 
sensing means is selected from the group consisting of a mass on a deformation sensor, a gyroscope 
and a differential GPS. 

22. (Previously Presented) User interaction system as claimed in claim 18 wherein the transmitted 
user interface information includes at least one feature selected from the group consisting of motion 
speed, motion direction, and acceleration of the pointing device. 

23. (Previously Presented) User interaction system as claimed in claim 19, wherein the transmitted 
user interface information includes at least one feature selected from the group consisting of motion 
trajectory of the pointing device and a characteristic signature derived from the motion trajectory of 
the pointing device. 

24. (Previously Presented) User interaction system as claimed in claim 18, further comprising room 
localization beacons for emitting electromagnetic radiation, wherein the digital signal processor is 
arranged to recognize to which part of the room the pointing device is pointing. 

25. (Previously Presented) User interaction system as claimed in claim 18, wherein the pointing 
device fiirther comprises feedback means for providing the user with additional information. 

26. (Previously Presented) User interaction system as claimed in claim 25, wherein said feedback 
means is selected from the group consisting of light, sound, a display and force feedback means. 
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27. (Previously Presented) Pointing device for use in a user interaction system as claimed in claim 
18, comprising a camera and being capable of sending a picture to a digital signal processor. 

28. (Previously Presented) Pointing device as claimed in claim 27, wherein the pointing device is 
capable of sending a picture to the digital signal processor, which is capable of sending user 
interface information to an electrical apparatus based on the picture. 

29. (Previously Presented) Pointing device as claimed in claim 27 wherein the digital signal 
processor is comprised in the pointing device. 

30. (Previously Presented) Pointing device as claimed in claim 27, comprising motion sensing means 
for sensing a motion trajectory of the pointing device. 

3 1 . (Previously Presented) Pointing device as claimed in claim 27, comprising a characteristic 
projector for optically projecting a characteristic pattern towards a region pointed to. 

32. (Previously Presented) Pointing device as claimed in claim 27, comprising a programmable user 
interface code generator and a wireless transmitter for transmitting the code to the electrical 
apparatus. 

33. (Previously Presented) Pointing device as claimed in claim 27 comprising feedback means for 
feedback of user interface information. 
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34. (Previously Presented) Electrical apparatus for use in a user interaction system as claimed in 
claim 18, characterized in that interface means are comprised which allow the electrical apparatus to 
send information about supported commands to a pointing device as claimed in claim 1, based on at 
least one call of the pointing device to the electrical apparatus. 

35. (Previously Presented) User interaction system, comprising: 

a first electrical apparatus; 

a portable pointing device operable by a user for pointing to a region in space; 

a camera ) connected to the pointing device so that in operation it images the region pointed 
to for taking a picture; 

a digital signal processor, capable of receiving and processing data of said picture, and 
capable of transmitting user interface information derived on the basis of said picture data to the first 
electrical apparatus; and 

an object displaying a characteristic pattern to facilitate recognition of said object by the 
digital signal processor. 

36. (new) User interaction system as claimed in claim 35, wherein the object displaying a 
characteristic pattern is a second electrical apparatus. 

37. (Previously Presented) User interaction system as claimed in claim 35, wherein the second 
electrical 

apparatus comprises a display. 
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38. (Previously Presented) User interaction system as claimed in claim 35 in which the second 
electrical apparatus is in fact the first electrical apparatus. 

39. (Previously Presented) Pointing device for use in a user interaction system as claimed in claim 
35, comprising a camera and being capable of sending a picture to a digital signal processor. 

40. (new) Pointing device as claimed in claim 39, wherein the pointing device is capable of 
sending a picture to the digital signal processor, which is capable of sending user interface 
information to an electrical apparatus based on the picture. 

41 . (Previously Presented) Pointing device as claimed in claim 39 wherein the digital signal 
processor is comprised in the pointing device. 

42. (Previously Presented) Pointing device as claimed in claim 39, comprising motion sensing means 
for sensing a motion trajectory of the pointing device. 

43. (Previously Presented) Pointing device as claimed in claim 39, comprising a characteristic 
projector for optically projecting a characteristic pattern towards a region pointed to. 

44. (Previously Presented) Pointing device as claimed in claim 39, comprising a programmable user 
interface code generator and a wireless transmitter for transmitting the code to the electrical 
apparatus. 
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45. (Previously Presented) Pointing device as claimed in claim 39 comprising feedback means for 
feedback of 

user interface information. 

46. (Previously Presented) Electrical apparatus for use in a user interaction system as claimed in 
claim 35, wherein interface means allow the electrical apparatus to send information about supported 
commands to a pointing device, based on at least one identify supported commands call of the 
pointing device to the electrical apparatus. 

47. (Previously Presented) User interaction system, comprising: 

an electrical apparatus; 

a portable pointing device operable by a user for pointing to a region in space; 
a camera connected to the pointing device so that in operation it images the region pointed to 
for taking a picture; 

a digital signal processor, capable of receiving and processing data of said picture, and 
capable of transmitting user interface information derived on the basis of said picture data to the 
electrical apparatus; and 

wherein said user interface information includes a specification of the electrical apparatus, or 
of a part of the electrical apparatus intended to be used by the user. 

48. (Previously Presented) User interaction system as claimed in claim 47, wherein the electrical 
apparatus, or the intended part of the electrical apparatus is identified by determining the position of 
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the electrical apparatus in the picture of the region pointed to. 

49. (Previously Presented) User interaction system as claimed in claim 48, wherein the electrical 
apparatus, or the intended part of the electrical apparatus corresponds to a fixed position in the 
picture. 

50. (Previously Presented) User interaction system as claimed in claim 47, fiirther comprising means 
for feedback generation on basis of said transmitted user interface information. 

51. (Previously Presented) User interaction system as claimed in claim 50, wherein the means for 
feedback generation include the generation of visual/auditory signals in proximity to the electrical 
apparatus, or to the intended part of the electrical apparatus. 

52. (Previously Presented) Pointing device for use in a user interaction system as claimed in claim 
47, comprising a camera and being capable of sending a picture to a digital signal processor. 

53. (Previously Presented) Pointing device as claimed in claim 52, wherein the pointing device is 
capable of sending a picture to the digital signal processor, which is capable of sending user 
interface information to an electrical apparatus based on the picture. 

54. (Previously Presented) Pointing device as claimed in claim 52 wherein the digital signal 

processor is operatively associated with the pointing device. 

55. (Previously Presented) Pointing device as claimed in claim 52, comprising motion sensing means 
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for sensing a motion trajectory of the pointing device. 

56. (Previously Presented) Pointing device as claimed in claim 52, comprising a characteristic 
projector for 

optically projecting a characteristic pattem towards a region pointed to. 

57. (Previously Presented) Pointing device as claimed in claim 52, comprising a programmable user 
interface code generator and a wireless transmitter for transmitting the code to the electrical 
apparatus. 

58. (Previously Presented) Pointing device as claimed in claim 52 comprising feedback means for 
feedback of user interface information. 

59. (Previously Presented) Electrical apparatus for use in a user interaction system as claimed in 
claim 47, comprising means allowing the electrical apparatus to send information about supported 
commands to a pointing device, based on an "identify supported commands" call of the pointing 
device to the electrical apparatus. 

60. (New) User interaction system, comprising: 

an electrical apparatus; 

a portable pointing device operable by a user for pointing to a region in space; 
a camera taking a picture; and 

a digital signal processor, capable of receiving and processing the picture, and capable 
of transmitting user interface information derived from the picture to the electrical apparatus, 
wherein the camera is connected to the pointing device so that in operation it images the region 
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pointed to characterized in that the system further comprises at least one localization beacon that can 
emit electromagnetic radiation, which can be captured by the system and for use to the digital signal 
processor in order to recognize to where the pointing device is pointing by using information derived 
from the captured electromagnetic radiation. 

61 (New) The user interaction system as in claim 60, wherein the digital signal processor (120) 
is further arranged to recognize the direction of the pointer relative to the localization beacon. 

62 (New) The user interaction system as in claim 60, further comprising motion sensing means 
for enabling estimating a motion or a motion trajectory of the pointing device. 

63 (New) The user interaction system as in claim 60, wherein the motion or the motion 
trajectory of the pointing device is estimated on basis of successive pictures imaged by the camera at 
respective instances of time. 

64 (New) User interaction system as claimed in claim 61 wherein the transmitted user interface 
information includes at least one feature selected from the group consisting of motion speed, and 
motion direction of the pointing device. 

65. (New) User interaction system as claimed in claim 62, wherein the transmitted user interface 
information includes at least one feature selected from the group consisting of motion trajectory of 
the pointing device and a characteristic signature derived from the motion trajectory of the pointing 
device. 

66. (New) User interaction system as claimed in one of claims 60, wherein the pointing device 
(101) further comprises feedback means for providing the user with additional information. 

67. (New) User interaction system as claimed in claim 66, wherein said feedback means is 
selected fi-om the group consisting of light, sound, a display and force feedback means. 
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68. (New) User interaction system as in one of claims 60, wherein the user interface information 
comprises apparatus control data for controlling operation of the electrical apparatus. 

69. ( New) Pointing device for use in a user interaction system as in one of claims 60, 
characterized in that it comprises the digital signal processor and a camera and wherein the pointing 
device is capable of sending a picture to the digital signal processor. 

70. ( New) Pointing device as in claim 69, comprising a characteristic projector for optically 
projecting a characteristic pattern towards a region pointed to. 

71 . ( New) Pointing device as in claim 60, comprising a programmable user interface code 
generator and a wireless transmitter for transmitting the code to the electrical apparatus. 

72. ( New) Electrical apparatus for use in a user interaction system as in claim 60, characterized 
in that interface means are comprised which allow the electrical apparatus to send information about 
supported commands to a pointing device, based on an "identify supported commands" call of the 
pointing device to the electrical apparatus. 
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